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7 TARGETED ADVERTISING DURING PLAYBACK OF STORED CONTENT 
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1 1 FIELD OF THE INVENTION 

^ This invention relates generally to the field of advertising. More particularly, 

iSj this invention relates to a method of enhancing the effectiveness of advertising 

1 f 5^ during a playback of stored entertainment content. 

BACKGROUND OF THE INVENTION 

^ la Video Cassette Recorders (VCRs) have enabled users to readily record and 

1 8J play back television programming, movies and other entertainment content for a 

1 $u number of years. Video Cassette Recorders (and other Video Tape Recorders 

2(jj (VTRs)) are linear devices that begin recording at a starting point of the tape and 

21 commence linearly until the recording is terminated by the end of the tape or by 

22 user or automated intervention to halt the recording. Playback is similarly a linear 

23 process with a starting and ending point on the tape. When television 

24 programming is recorded, advertisements appearing in the programming at the 

25 time of recording are typically also recorded and are thus presented again for 

26 viewing during the playback of the recorded programming. 

2^ As the storage capacity, cost per Megabyte and speed of nonlinear (random 

28 access) recording media such as hard disc drives and optical disc drives has 

29 improved, such devices have begun to replace the linear tape-based recording 
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1 media. Set-top boxes using hard disc drives to record, store and play back content 

2 are expected to emerge as the next generation of video recording devices. Several 

3 stand-alone devices that use disc drive storage for recording and playback of 

4 content, referred to as Personal Video Recorders (PVRs), are now available from 

5 Sony Corporation, Tivo Corporation and others. As the capabilities of Television 

6 Set-top boxes increases, it is anticipated that STBs using nonlinear storage will 

7 form the core of a home entertainment system and include the recording 

8 capabilities of the stand-alone disc-based record/playback devices (e.g., PVRs) 

9 currently on the market. Standalone PVR devices and disc drive storage systems 

1 0 are also being designed to actively interact with STB systems to form storage for 

11 home networks. The nonlinear nature of disc storage used for storage of 
1 programming materials facilitates scanning and manipulation of the content. 

m 

SUMMARY OF THE INVENTION 

1 S The present invention relates generally to advertising. Objects, advantages 

I ^ and features of the invention will become apparent to those skilled in the art upon 

I I consideration of the following detailed description of the invention. 

1 1 One embodiment of the present invention relates to an advertising technique 

1 9=1 for use during the playback of stored entertainment content. A set-top box notifies 

2(|3 a service provider of the selection of playback of stored content by a user. The 
service provider uses user profile information and other information to select 

22 targeted advertisements for the user and the advertisements are merged with the 

23 stored content for presentation to the user. 

24 A method of playback of stored entertainment content consistent with certain 

25 embodiments of the invention include: notifying a service provider of a playback of 

26 the stored entertainment content; receiving an advertisement from an advertising 

27 server; and merging the advertisement with the stored entertainment content so 

28 that both the advertisement and the stored entertainment content are played back. 

29 In another embodiment consistent with the present invention, a method of 

30 delivering advertisements to a user includes: receiving a message from a set-top 
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1 box indicating initiation of the playback of stored entertainment content; selecting 

2 an advertisement based on a user profile for the user; and transmitting the 

3 advertisement to the set-top box to be merged with the entertainment content. 

4 An exemplary set-top box consistent with embodiments of the present 

5 invention includes an input interface receiving a signal indicating that a user has 

6 initiated a playback of stored entertainment content. A service provider is notified 

7 by the STB of the initiation of the playback of stored entertainment content. A 

8 selected advertisement is received from the service provider. A programmed 

9 processor merges the selected advertisement with the entertainment content so 
1 0 that the entertainment content is played back with the selected advertisement. 

"•I An exemplary system for delivery of advertisements consistent with the 
present invention includes a mechanism for receiving a message from a set-top 

1 3p box indicative of a user's selection of playback of stored entertainment content. A 

14f5 user profile server stores a user profile of the user. An advertisement server 

15y receives the user profile and supplies an advertisement selected in accordance 

1@P with the user profile. The advertisement is transmitted to the set-top box for 

1 7" merging at playback with the entertainment content. 

electronic storage medium consistent with one embodiment of the 

19j invention stores instructions which, when executed on a programmed processor, 

2(g carry out a process of playback of stored entertainment content includes: notifying 

2t- a service provider of a playback of the stored entertainment content; receiving an 

22 advertisement from an advertising server; and merging the advertisement with the 

23 stored entertainment content so that both the advertisement and the stored 

24 entertainment content are played back. 

25 Another electronic storage medium consistent with embodiments of the 

26 invention stores instructions which, when executed on a programmed processor, 

27 carry out a process of delivering advertisements to a user including: receiving a 

28 message from a set-top box indicating initiation of playback of stored entertainment 

29 content; selecting an advertisement based on a user profile for the user; and 
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1 transmitting the advertisement to the set-top box to be merged with the 

2 entertainment content. 

3 A method of doing business using embodiments of the present invention 

4 include: receiving an advertisement from an advertiser; receiving a target profile 

5 defining the type of viewer that should receive the advertisement; receiving 

6 notification from users indicative of playback of entertainment content; providing 

7 users with the advertisement based upon similarities between a user profile and 

8 the target profile, the advertisement being provided by merging the advertisement 

9 with the entertainment content; and calculating a charge to the advertiser based 

1 0 upon the number of times the advertisement is provided to users. 

1 1 The above summaries are intended to illustrate exemplary embodiments of 
12,„^ the invention, which will be best understood in conjunction with the detailed 
13y description to follow, and are not intended to limit the scope of the appended 

''hi 

14n claims. 

1 ej BRIEF DESCRIPTION OF THE DRAWINGS 

17= The features of the invention believed to be novel are set forth with 

18;;^: particularity In the appended claims. The invention itself however, both as to 

1%! organization and method of operation, together with objects and advantages 

20:;=] thereof, may be best understood by reference to the following detailed description 

21'' of the invention, which describes certain exemplary embodiments of the invention, 

22 taken in conjunction with the accompanying drawings in which: 

23 FIGURE 1 is a system block diagram of a system using a set-top box. 

24 FIGURE 2 is a functional block diagram of a digital set-top box suitable for 

25 use with the present invention. 

26 FIGURE 3 is a flow chart of a process consistent with a video on demand 

27 embodiment of the present invention. 

28 FIGURE 4 is a flow chart of a process consistent with a local or remote 

29 storage based video playback system. 
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1 DETAILED DESCRIPTION OF THE INVENTION 

2 While this invention is susceptible of embodiment in many different forms, 

3 there is shown in the drawings and will herein be described in detail specific 

4 embodiments, with the understanding that the present disclosure is to be 

5 considered as an example of the principles of the invention and not intended to limit 

6 the invention to the specific embodiments shown and described. In the description 

7 below, like reference numerals are used to describe the same, similar or 

8 corresponding parts in the several views of the drawings. 

9 Referring to FIGURE 1, a block diagram for an exemplary interactive cable 

10 or satellite television (TV) system 100 is shown. The system 100 includes, at a 

1 1 head end of the service provider 1 0, a media server 1 2 for providing, on demand, 
12^ movies and other programming obtained from a media database 14. The media 
1 31 server 1 2 might also provide additional content such as interviews with the actors, 
1 40 games, advertisements, available merchandise, associated Web pages, interactive 
1$Q games and other related content. The system 100 also includes an electronic 
1^J^ programming guide (EPG) server 16 and a program listing database 18 for 
17; generating an EPG. Set-top box 22 can generally provide for bidirectional 
lCr^ communication over a transmission medium 20 in the case of a cable STB 22. In 
19^^^ other embodiments, bidirectional communication can be effected using 
203 asymmetrical communication techniques possibly using dual communication 

21 media - - one for the uplink and one for the downlink. In any event, the STB 22 can 

22 have its own Universal Resource Locator (URL) or IP address or other unique 

23 identifier assigned thereto to provide for addressability by the head end and users 

24 of the Internet. 

25 The media server 12 and EPG server 16 are operatively coupled by 

26 transmission medium 20 to a set-top box (STB) 22. The transmission medium 20 

27 may include, for example, a conventional coaxial cable network, a fiber optic cable 

28 network, telephone system, twisted pair, a satellite communication system, a radio 

29 frequency (RF) system, a microwave system, other wireless systems, a 
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1 combination of wired and wireless systems or any of a variety of known electronic 

2 transmission mediums. In the case of a cable television network, transmission 

3 medium 20 is commonly realized at the subscriber's premises as a coaxial cable 

4 that is connected to a suitable cable connector at the rear panel of the STB 22. In 

5 the case of a Direct Satellite System (DSS), the STB 22 is often referred to as an 

6 Integrated Receiver Decoder (IRD). In the case of a DSS system, the transmission 

7 medium is a satellite transmission at an appropriate microwave band. Such 

8 transmissions are typically received by a satellite dish antenna with an integral Low 

9 Noise Block (LNB) that serves as a down-converter to convert the signal to a lower 

1 0 frequency for processing by the STB 22. 

11 The exemplary system 100 further includes a TV 24, such as a digital 
1 23 television, having a display 26 for displaying programming, an EPG, etc. The STB 
1 22 may be coupled to the TV 24 and various other audio/visual devices 26 (such as 
lf j audio systems, Personal Video Recorders (PVRs), Video Tape Recorders (VTRs), 
153 Video Cassette Recorders (VCRs) and the like), storage devices (e.g., hard disc 
1^0 drives) and Internet Appliances 28 (such as email devices, home appliances, 

storage devices, network devices, and other Internet Enabled Appliances) by an 

18f appropriate interi'ace 30, which can be any suitable analog or digital interi'ace. In 

10y one embodiment, interi'ace 30 conforms to an interface standard such as the 

20;' Institute of Electrical and Electronics Engineers (IEEE) 1394 standard, but could 

21 also be wholly or partially supported by a DVI interface (Digital Visual Interface - 

22 Digital Display Working Group, www.ddwg.org) or other suitable interface. 

23 The STB 22 may include a central processing unit (CPU) such as a 

24 microprocessor and memory such as Random Access Memory (RAM), Read Only 

25 Memory (ROM), flash memory, mass storage such as a hard disc drive, floppy disc 

26 drive, optical disc drive or may accommodate other electronic storage media, etc. 

27 Such memory and storage media is suitable for storing data as well as instructions 

28 for programmed processes for execution on the CPU, as will be discussed later. 

29 Information and programs stored on the electronic storage media or memory may 

30 also be transported over any suitable transmission medium such as that illustrated 
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1 as 20. STB 22 may include circuitry suitable for audio decoding and processing, 

2 the decoding of video data compressed in accordance with a compression 

3 standard such as the Motion Pictures Experts Group (MPEG) standard and other 

4 processing to form a controller or central hub. Alternatively, components of the 

5 STB 22 may be incorporated into the TV 24 itself, thus eliminating the STB 22. 

6 Further, a computer having a tuner device and modem may be equivalently 

7 substituted for the TV 24 and STB 22. 

8 By way of example, the STB 22 may be coupled to devices such as a 

9 personal computer, video cassette recorder, camcorder, digital camera, personal 

10 digital assistant and other audio/visual or Internet related devices. In addition, a 

1 1 data transport architecture, such as that set forth by an industry group which 
1^ includes Sony Corporation and known as the Home Audio-Video Interoperability 
1 ^ (HAVi) architecture may be utilized to enable interoperability among devices on a 
1 m network regardless of the manufacturer of the device. This forms a home network 
1^ system wherein electronic devices and Internet appliances are compatible with 
1& each other. The STB 22 runs an operating system suitable for a home network 
1if^ system such as Sony Corporation's Aperies™ real time operating system. Other 
1 operating systems could also be used. 

1 % The STB 22 includes an infrared (IR) receiver 34 for receiving IR signals from 

2(g an input device such as remote control 36. Alternatively, it is noted that many other 

21 control communication methods may be utilized besides IR, such as wired or 

22 wireless radio frequency, etc. In addition, it can be readily appreciated that the 

23 input device 36 may be any device suitable for controlling the STB 22 such as a 

24 remote control, personal digital assistant, laptop computer, keyboard or computer 

25 mouse. In addition, an input device in the form of a control panel located on the TV 

26 24 or the STB 22 can be provided. 

27 The STB 22 may also be coupled to an independent service provider (ISP) 

28 host 38 by a suitable connection including dial-up connections, DSL (Digital 

29 Subscriber Line) or the same transmission medium 20 described above (e.g., using 

30 a cable modem) to, thus, provide access to services and content from the ISP and 
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1 the Internet. The ISP host 38 provides various content to the user that is obtained 

2 from a content database 42. STB 22 may also be used as an Internet access 

3 device to obtain information and content from remote servers such as remote 

4 server 48 via the Internet 44 using host 38 operating as an Internet portal, for 

5 example. In certain satellite STB environments, the data can be downloaded at 

6 very high speed from a satellite link, with asymmetrical upload speed from the set- 

7 top box provided via a dial-up or DSL connection. 

8 While the arrangement illustrated in FIGURE 1 shows a plurality of servers 

9 and databases depicted as independent devices, any one or more of the servers 

1 0 can operate as server software residing on a single computer. Moreover, although 

1 1 not explicitly illustrated, the servers may operate in a coordinated manner under 
1 % centralized or distributed control to provide multiple services as a Multiple Service 
1 ^ Operator (MSO) in a known manner. Additionally, the services provided by the 
1fJ servers shown in FIGURE 1 may actually reside in other locations, but from the 
1 ^ perspective of the user of STB 22, the service provider 1 0 serves as a portal to the 
''ft services shown. Those skilled in the art will appreciate that the illustration of 
1 FIGURE 1 represents a simplified depiction of a cable system configuration shown 
1 ^ simply as service provider 1 0. The actual configuration of the service provider's 
Iffi equipment is more likely to follow a configuration defined by the CableLabs 
^fc OP®"Cable™ specification. The simplified illustration shown is intended to simplify 

21 the discussion of the service provider 10's operation without unnecessarily 

22 burdening the discussion with architectural details that will be evident to those 

23 skilled in the art. Those details can be found in the publicly available CableLabs 

24 OpenCable™ specification or in the text "OpenCable Architecture (Fundamentals)" 

25 by Michael Adams, Cisco Press, Nov. 1999. 

26 Referring now to FIGURE 2, a typical system configuration for a digital set- 

27 top box 22 is illustrated. In this exemplary set-top box, the transmission medium 

28 20, such as a coaxial cable, is coupled by a suitable interface through a diplexer 

29 1 02 to a tuner 1 04. Tuner 1 04 may, for example, include a broadcast in-band tuner 
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1 for receiving content, an cut-of-band (OOB) tuner for receiving data transmissions. 

2 A return path through diplexer 1 02 provides an OOB return path for outbound data 

3 (destined for example for the head end). A separate tuner (not shown) may be 

4 provided to receive conventional RF broadcast television channels. Modulated 

5 information formatted, for example, as MPEG-2 information is then demodulated 

6 at a demodulator 1 06. The demodulated information at the output of demodulator 

7 106 is provided to a demultiplexer and descrambler circuit 110 where the 

8 information is separated into discrete channels of programming. The programming 

9 is divided into packets, each packet bearing an identifier called a Packet ID (RID) 

10 that identifies the packet as containing a particular type of data (e.g., audio, video, 

11 data). The demodulator and descrambler circuit 110 also decrypts encrypted 
information in accordance with a decryption algorithm to prevent unauthorized 

1 access to programming content, for example. 

"•fj Audio packets from the demultiplexer 110 (those identified with an audio 

15 PID) are decrypted and forwarded to an audio decoder 114 where they may be 

1 ^ converted to analog audio to drive a speaker system (e.g. , stereo or home theater 

17_ multiple channel audio systems) or other audio system 1 16 (e.g., stereo or home 

Ifi theater multiple channel amplifier and speaker systems) or may simply provide 

1» decoded audio out at 118. Video packets from the demultiplexer 110 (those 

2fe identified with a video RID) are decrypted and forwarded to a video decoder 122. 

2i' In a similar manner, data packets from the demultiplexer 1 1 0 (those identified with 

22 a data RID) are decrypted and forwarded to a data decoder 126. 

23 Decoded data packets from data decoder 1 26 are sent to the set-top box's 

24 computer system via the system bus 1 30. A central processing unit (CPU) 132 can 

25 thus access the decoded data from data decoder 126 via the system bus 130. 

26 Video data decoded by video decoder 1 22 is passed to a graphics processor 1 36, 

27 which is a computer optimized to processes graphics information rapidly. Graphics 

28 processor 136 is particularly useful in processing graphics intensive data 

29 associated with Internet browsing, gaming and multimedia applications such as 

30 those associated with MHEG (Multimedia and Hypermedia information coding 
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1 Experts Group) set-top box applications. It should be noted, however, that the 

2 function of graphics processor 136 may be unnecessary in some set-top box 

3 designs having lower capabilities, and the function of the graphics processor 1 36 

4 may be handled by the CPU 1 32 in some applications where the decoded video is 

5 passed directly from the demultiplexer 11 0 to a video encoder. Graphics processor 

6 1 36 is also coupled to the system bus 1 30 and operates under the control of CPU 

7 132. 

8 Many set-top boxes such as STB 22 may incorporate a smart card reader 

9 1 40 for communicating with a so called "smart card," often serving as a Conditional 

1 0 Access Module (CAM). The CAM typically includes a central processor unit (CPU) 

1 1 of its own along with associated RAM and ROM memory. Smart card reader 1 40 
1 J is used to couple the system bus of STB 22 to the smart card serving as a CAM 
1# (not shown). Such smart card based CAMs are conventionally utilized for 
1 f1 authentication of the user and authentication of transactions carried out by the user 
1 g as well as authorization of services and storage of authorized cryptography keys. 
1^ For example, the CAM can be used to provide the key for decoding incoming 
1 i cryptographic data for content that the CAM determines the user is authorized to 
1 St receive. 

ff[ STB 22 can operate in a bidirectional communication mode so that data and 

2Q3 other information can be transmitted not only from the system's head end to the 

21 ' end user, or from a service provider to the end user of the STB 22, but also, from 

22 the end user upstream using an out-of-band channel. In one embodiment, such 

23 data passes through the system bus 1 30 to a modulator 1 44 through the diplexer 

24 102 and out through the transmission medium 20. This capability is used to 

25 provide a mechanism for the STB 22 and/or its user to send information to the head 

26 end (e.g. , service requests or changes, registration information, etc.) as well as to 

27 provide fast outbound communication with the Internet or other services provided 

28 at the head end to the end user. 

29 Set-top box 22 may include any of a plurality of I/O (Input/Output) interfaces 

30 represented by I/O interfaces 1 46 that permit interconnection of I/O devices to the 
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1 set-top box 22. By way of example, and not limitation, a serial RS-232 port 1 50 can 

2 be provided to enable interconnection to any suitable serial device supported by the 

3 STB 22's internal software. Similarly, communication with appropriately compatible 

4 devices can be provided via an Ethernet port 1 52, a USB (Universal Serial Bus) port 

5 1 54, an IEEE 1 394 (so-called firewire™ or i-link™) or IEEE 1 394 wide port 1 56, S- 

6 video port 1 58 or infrared port 1 60. Such interfaces can be utilized to interconnect 

7 the STB 22 with any of a variety of accessory devices such as storage devices, 

8 audio / visual devices 26, gaming devices (not shown), Internet Appliances 28, etc. 

9 I/O interfaces 146 can include a modem (be it dial-up, cable, DSL or other 

1 0 technology modem) having a modem port 1 62 to facilitate high speed or alternative 

1 1 access to the Internet or other data communication functions. In one preferred 
12=, embodiment, modem port 162 is that of a DOCSIS (Data Over Cable System 
1 33 Interface Specification) cable modem to facilitate high speed network access over 
Hfl a cable system, and port 162 is appropriately coupled to the transmission medium 
141 20 embodied as a coaxial cable. Thus, the STB 22 can carry out bidirectional 
I^J communication via the DOCSIS cable modem with the STB 22 being identified by 
11 a unique IP address. The DOCSIS specification is publically available. 

18' J A PS/2 or other keyboard / mouse / joystick interface such as 164 can be 

1 ^ provided to permit ease of data entry to the STB 22. Such inputs provide the user 

2Q':3 with the ability to easily enter data and/or navigate using pointing devices. Pointing 

2T devices such as a mouse or joystick may be used in gaming applications. 

22 Of course, STB 22 also may incorporate basic video outputs 1 66 that can be 

23 used for direct connection to a television set such as 24 instead of (or in addition 

24 to) an IEEE 1394 connection such as that illustrated as 30. In one embodiment, 

25 Video output 166 can provide composite video formatted as NTSC (National 

26 Television System Committee) video. In some embodiments, the video output 166 

27 can be provided by a direct connection to the graphics processor 136 or the 

28 demultiplexer / descrambler 110 rather than passing through the system bus 130 

29 as illustrated in the exemplary block diagram. S-Video signals from output 1 58 can 
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1 be similarly provided without passing through the system bus 1 30 if desired in other 

2 embodiments- 

3 The infrared port 160 can be embodied as an infrared receiver 34 as 

4 illustrated in FIGURE 1, to receive commands from an infrared remote control 36, 

5 infrared keyboard or other infrared control device. Although not explicitly shown, 

6 front panel controls may be used in some embodiments to directly control the 

7 operation of the STB 22 through a front panel control interface as one of interfaces 
6 146. Selected interfaces such as those described above and others can be 
9 provided in STB 22 in various combinations as required or desired. 

1 0 STB 22 will more commonly, as time goes on, include a disc drive interface 

11 1 70 and disc drive mass storage 1 72 for user storage of content and data as well 
Its as providing storage of programs operating on CPU 132. STB 22 may also include 
1^ floppy disc drives, CD ROM drives, CD R/W drives, DVD drives, etc. CPU 132, in 
If; order to operate as a computer, is coupled through the system bus 130 (or through 
150 a multiple bus architecture) to memory 176. Memory 178 may include a 
16fj combination any suitable memory technology including Random Access Memory 
17:^. (RAM), Read Only Memory (ROM), Flash memory, Electrically Erasable 
1 8^ Programmable Read Only Memory (EEPROM), etc. 

1^y While the above exemplary system including STB 22 is illustrative of the 

2C>^f basic components of a digital set-top box suitable for use with the present 

21 invention, the architecture shown should not be considered limiting since many 

22 variations of the hardware configuration are possible without departing from the 

23 present invention. The present invention could, for example, also be implemented 

24 in more advanced architectures such as that disclosed in U.S. Patent Application 

25 Serial No. 09/473,625, filed Dec. 29, 1999, Docket No. SONY-50N3508 entitled 

26 "Improved Internet Set-Top Box Having and In-Band Tuner and Cable Modem" to 

27 Jun Maruo and Atsushi Kagami. This application describes a set-top box using a 

28 multiple bus architecture with a high level of encryption between components for 

29 added security. This application is hereby incorporated by reference as though 

30 disclosed fully herein. 
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1 In general, during operation of the STB 22, an appropriate operating 

2 systemi 80 such as, for example, Sony Corporation's Aperios^^ real time operating 

3 system is loaded Into, or is permanently stored in, active memory along with the 

4 appropriate drivers for communication with the various interfaces. In other 

5 embodiments, other operating systems such as Microsoft Corporation's Windows 

6 CE™ could be used without departing from the present invention. Along with the 

7 operating system and associated drivers, the STB 22 usually operates using 

8 browser software 182 in active memory or may permanently reside in ROM, 

9 EEPROM or Flash memory, for example. The browser software 182 typically 

10 operates as the mechanism for viewing not only web pages on the Internet, but 

1 1 also serves as the mechanism for viewing an Electronic Program Guide (EPG) 
123 formatted as an HTML document. The browser 182 can also provide the 
l^j mechanism for viewing normal programming (wherein normal programming is 

viewed as an HTML video window - often occupying the entire area of screen 26). 

''€1 STB software architectures vary depending upon the operating system. 

1 j( However, in general, all such architectures generally include, at the lowest layer, 

1 F ^ various hardware interface layers. Next is an operating system layer as previously 

1 ^ described. The software architectures of modern STB have generally evolved to 

1^ include a next layer referred to as "middleware." Such middleware permits 

2C applications to run on multiple platforms with little regard for the actual operating 

21 system in place. Middleware standards are still evolving at this writing, but are 

22 commonly based upon Javascript and HTML (hypertext Markup Language) virtual 

23 machines. At the top layer is the application layer where user applications and the 

24 like reside (e.g., browsing, email, EPG, Video On Demand (VOD), rich multimedia 

25 applications, pay per view, etc.). The current invention can be utilized with any 

26 suitable set-top box software and hardware architecture. 

In accordance with embodiments of the present invention, the STB can be 

28 utilized to enhance the efl'ectiveness of advertisements directed at the viewer of 

29 recorded content. This not only enhances the possibility of revenue for the 

30 advertiser and the service provider, but can also be used to provide the user with 
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1 targeted promotional information that is more likely to be of interest to the user and 

2 is less repetitive than current advertising techniques. For example, a 25 year-old 

3 single male without children can be spared from advertisements for baby food in 

4 favor of, for example, advertisements for night clubs or sporting events - - that is, 

5 advertisements which, demographically speaking, are more likely to be of interest. 

6 Moreover, when specific favorite content is played back repeatedly, new or different 

7 advertisements can be directed at the user. 

8 Referring back to FIG U RE 1, in one embodiment of the invention, theservice 

9 provider 1 0 head end includes an advertisement server 56 including a database 58 

10 of advertisements supplied by various entities that pay to have advertising 

1 1 distributed to subscribers. In addition a user profile server 66 having a database 
13j 68 of user profiles of subscribers is also provided at the service provider 1 0 head 
lf{ end. In general, the servers 12, 16, 56 and 66 as well as host 38 are described as 
1i1 independent servers, but those skilled in the art will appreciate that the servers 
1 i|i operate in a coordinated manner and may in fact be implemented in fewer or more 
1^ actual computer systems than depicted in FIGURE 1. 

17 In general, upon subscribing to a cable or satellite entertainment system or 

lE service, the subscriber is asked to provide certain information such as name, 

1^1 address, telephone number etc. As part of this process, the subscriber can also 

2Sl provide a user profile for the subscriber and members of his or her household. Any 

21 number of profile parameters can be gathered during a setup process for the 

22 system including age, sex, marital status, programming favorites, hobbies, etc. In 

23 certain embodiments of the present invention, such data can be used to correlate 

24 the user to advertising of most interest to the user. Profile parameters can also be 

25 gathered manually, electronically or via an interview and updated periodically. 

26 In accordance with a first embodiment of the invention, consider a Video-On- 

27 Demand (VOD) scenario. In this scenario, content is provided by and stored at the 

28 service provider 1 0 at media server 12 within the media database 1 4. When the 

29 user wishes to purchase a VOD selection, the media server 12 retrieves the data 
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1 from the media database 14 and delivers it to STB 22 for playback to the user. 

2 Since the playback is an individual playback for the user, advertisements can be 

3 individually selected for the user based upon the user's individual profile. For 

4 multiple users of the same system, access codes are authenticated for the 

5 particular user selecting the VOD selection in order to assure authorization and 

6 payment. As a part of the information exchange during the authentication process 

7 (or at another time), the STB 22 can also provide the head end with a viewing 

8 history for the current user or household. Thus, the individual user whose access 

9 code is associated with the VOD selection can be identified for targeted advertising 

10 and his use profile can be updated to reflect recent viewing history. In addition to 

1 1 these factors, advertising can be varied depending upon the content, advertisement 
1^ history, playback time and date and/or other factors. That is, the particular 
1 m advertisement associated with the VOD selection is not static and, thus, more likely 
14= to be subject to becoming obsolete (e.g. , discontinued products or services, events 
1 ^ that have already taken place, etc.) or tiring to the viewer. 

1 J This VOD process is illustrated as 300 in FIGURE 3 which starts at 302 and 

17 in which the user establishes a profile at 306. The profile can be established as 

1 % part of the user's registration for service with the service provider 1 0 and updated 

iCj periodically. At 310, the user makes a VOD selection to begin the process of 

2g playing back content from the service provider 1 0. At 31 4, the user is authenticated 

2f at the STB 22 using the security features of a smart card as previously described, 

22 for example. 

23 Assuming successful authentication at 31 4, the STB 22 downloads a history 

24 of recently viewed programming to the head end for assimilation by the user profile 

25 server 66 to refine the characterization of the user's viewing habits at 316. A 

26 message is sent to the service provider 1 0 at 31 8 to place the authenticated VOD 

27 order. The service provider 10 then queries the user profile database 68 of user 

28 profile server 66 to obtain profile information relating to the user at 322. The profile 

29 information is then used by the advertising server 56 along with the history 

30 information, time of day, date, advertisement history and VOD selection to correlate 
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1 to advertisements stored in the advertisement database 58 that appropriately target 

2 the user at 326. 

3 The media server12 then merges the advertisements selected by the 

4 advertising server 66 with the content from the media database 14 at 330 and 

5 delivers the content, including embedded targeted advertisements to the user at 

6 334. The process is repeated each time the user selects a new VOD selection so 

7 that a new set of advertisements is provided. By way of example, if the user's 

8 profile indicates that he is a 26 year old male with an interest in sports and is 

9 ordering a sports related VOD selection, advertisements for sports apparel, sporting 

10 events and the like are likely of interest. Whereas, if the user is a 56 year-old 

11 female with an interest in the arts and the VOD selection is a drama, such 
1 % advertising would likely have very low effectiveness compared with advertisements 
1 tj for book dealers, museum exhibits and live theater events. In other embodiments, 
1 4fj the advertisements can be downloaded separately to the STB 22 and the merging 
1 ^ of the VOD selection and the advertisements can be carried out within the STB 22 
W either in real time during playback or stored with the content at a rate higher than 
1 f the playback rate for later playback. 

1 ^ In accordance with a second embodiment of the invention, consider a 

1 m scenario wherein the user is playing back recorded content. This embodiment, is 

20? illustrated in the process shown as 400 in FIGURE 4. The process begins at 402 

2t' after which the user sets up an account and establishes a user profile at 404. At 

22 408, the user elects to record a particular item of programming content such as a 

23 television program. The content can be stored locally on the disc drive 1 72 of STB 

24 22 or within storage provided in an AA/ device 26 such as a PVR, personal 

25 computer , or other attached device having storage. Alternatively, the content can 

26 be stored remotely on storage provided by the service provider 10 or a remote 

27 server 48 without limitation. 

When the user elects to playback a selection at 412, the STB 22 notifies the 

29 service provider 1 0 of the playback at 41 8 and provides the service provider with 

30 information as to the content being played back as well as information about the 
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1 advertisements on the content being played back. The content might include 

2 recorded advertisements or merely advertisement place holders indicating a 

3 location where an advertisement is to be inserted. The viewing history is 

4 transmitted to the service provider at 424 as described previously. In this 

5 embodiment, a user authentication may not be required, so the STB may not be 

6 able to identify the user specifically and may have to use a profile associated the 

7 household or all members of the household at 430 as a query entry into the profile 

8 server's database 68. In any event, the profile and possibly other information such 

9 as date, time, viewing history, content information, advertising history, etc. is 

10 correlated at 436 with available advertisements in advertisement server 56 to 

1 1 appropriately select targeted advertisements. The selected advertisements are 
1 then downloaded to the STB 22 at 442 and the advertisements are merged with the 
1 SB content at 450 either dynamically during playback or by modification to the stored 
1*1 content to insert the new advertisements. This process is repeated whenever the 
1Si user makes a selection to playback programming content at 412. 

1 P Any available communication avenue between the STB 22 and the service 

17 provider 10 (e.g., DOCSIS modem, OOB modem, dial up connection, etc.) can be 

1$^' used to provide the communication needed to implement the present invention. 

193 Thus, the messages sent from the STB 22 to alert the service provider 10 of a 

2O3 playback event can be carried out over communication medium 20 using, for 

2f" example, a message generated by the CPU 132 under program control upon 

22 receipt of a playback command from remote controller 36 via the infrared interface 

23 (34, 160). The message can be transmitted using an OOB modem or DOCSIS 

24 modem forming part of the STB 22. The viewing history is readily accumulated at 

25 the STB 22 by monitoring viewing habits of the household and/or particular users 

26 and storing information about programs viewed on disc drive 1 72 for downloading 

27 to the service provider 10. When the advertisements are received from the 

28 advertisement server 56, they are stored, for example, in disc drive 172 or other 

29 available storage and merged with the playback content, for example by CPU 132 

30 operating under program control, either during playback or prior to playback in a 
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1 manner similar to a word processing mail merge function. In other embodiments, 

2 stored advertisements are replaced by overwriting the existing advertisements or 

3 substitution during playback. 

4 Any number of factors can be used to refine a target selection of 

5 advertisements for a particular viewer to make the advertisements more interesting, 

6 more effective and more likely to be viewed. Several factors are described in 

7 TABLE 1 below: 
8 



9 


FACTOR 


HOW THE FACTOR CAN INFLUENCE THE 
SELECTION OF ADVERTISEMENTS 


10 


Profile information 


can demographically and otherwise categorize the 
user, his or her interests and provide direct input from 
the user as to preferences 


1 J 


Time/date 


can be used to assure that obsolete advertisements 
are not displayed 




viewing Inistory 


can be used to further refine the user's preference for 
programming content and thus interest profile 


1 


currcML seieciion 


can oe usea to optimize pairing ot aavertising witn 
programming - i.e. an immediate interest in the 
program being viewed may correlate with an 
advertisement or category of advertisement's 
effectiveness 


ir 


advertisement history 


can be used to optimize the frequency any particular 
advertisement is provided to a user to maintain the 
user's interest without the user becoming annoyed 
with the advertisement 


15 


time 


can be used to optimize advertisement of goods that 
might be particularly attractive at a given time of day - 
e.g. late evening might correlate well to fast food 
delivery and morning might correlate well to coffee 
advertisements 

can be used as a factor in determining how much a 
particular advertisement should cost an advertiser 


16 




TABLE 1 



17 
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1 Of course, those skilled in the art will appreciate that the above examples of 

2 the factors that can be used to select a particular advertisement are merely 

3 illustrative of the many factors that an advertiser might correlate to the effectiveness 

4 of an advertisement. 

5 In view of the advantages to advertisers, the present invention can also be 

6 used as the basis of a business model in which advertisers pay for advertising 

7 based upon frequency and times of playback. Thus, in accordance with FIGURE 

8 5, a business model can be developed as described by process 500. The process 

9 starts at 504 and at 508, an advertiser provides advertisement content to the service 

1 0 provider 1 0 along with associated profiles for target advertisement recipients. The 

1 1 service provider 10, in accord with agreed upon terms, supplies the advertisement 
1 B to subscribers that match the profile provided by the advertiser at 51 2 in accord with 
1^ the processes previously described in connection with the present invention. The 
l}|: service provider, at 516, tallies each time the advertisement is supplied to a 

: TIP 

1 B subscriber and further tabulates the data broken down by such factors as time and 

1 % programming so that charges for the advertisement's distribution can be computed 
based upon time of presentation of the advertisement and programming content 

18^^ that the advertisement accompanied in an agreed upon manner at 520. 

1 ^ At 528 the charges are presented to the advertiser for payment and the 

2(P process ends at 536. Of course, refinements can be made to this process without 

21 departing from the basic process. For example, the service provider can run the 

22 advertisement profile against viewing histories for a previous period of time to 

23 determine an estimate of the cost for the advertiser. Moreover, the advertiser, upon 

24 gaining experience with the response to the advertisement can refine the 

25 advertisement and/or the profile to enhance effectiveness. Any of the factors 

26 shown in TABLE 1 can be used to facilitate a match with the advertisement profile 

27 in accordance with the description of the invention provided above. 

28 While the above invention descnption suggests that the advertisements be 

29 modified or varied in accordance with certain disclosed parameters, those skilled 
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1 in the art will appreciate that any number of suitable triggers can be used to assert 

2 a particular change in an advertisement. For example, in other embodiments, a 

3 STB 22 can detect certain indications of a user's boredom (e.g., constant random 

4 shifting of channels) and can present a targeted advertisement, for example, for pay 

5 per view programming, to the user. Those skilled in the art will appreciate that 

6 many other factors can be used to trigger particular advertisements or types of 

7 advertisements without departing from the present invention. 

8 Those skilled in the art will recognize that the present invention has been 

9 described in terms of exemplary embodiments based upon use of a programmed 

10 processor. However, the invention should not be so limited, since the present 

1 1 invention could be implemented using hardware component equivalents such as 
1g special purpose hardware and/or dedicated processors which are equivalents to 
1;i the invention as described and claimed. Similarly, general purpose computers, 
lli microprocessor based computers, micro-controllers, optical computers, analog 
t| computers, dedicated processors and/or dedicated hard wired logic may be used 
1 J to construct alternative equivalent embodiments of the present invention. 

1 J Those skilled in the art will appreciate that the program steps used to 

Iff. implement the embodiments described above can be implemented using disc 

11 storage as well as other forms of storage including Read Only Memory (ROM) 

2© devices, Random Access Memory (RAM) devices; optical storage elements, 

2T magnetic storage elements, magneto-optical storage elements, flash memory, core 

22 memory and/or other equivalent storage technologies without departing from the 

23 present invention. Such alternative storage devices should be considered 

24 equivalents. 

25 The present invention is preferably implemented using a programmed 

26 processor executing programming instructions that are broadly described above in 

27 flow chart form, and can be stored on any suitable electronic storage medium. 

28 However, those skilled in the art will appreciate that the processes described above 

29 can be implemented in any number of variations and in many suitable 

30 programming languages without departing from the present invention. For 
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example, the order of certain operations carried out can often be varied, portions 
can be deleted and additional operations can be added without departing from the 
invention. Error trapping can be added and/or enhanced and variations can be 
made in user interface and Information presentation without departing from the 
present invention. Such variations are contemplated and considered equivalent. 

While the invention has been described in conjunction with specific 
embodiments, it is evident that many alternatives, modifications, permutations and 
variations will become apparent to those skilled in the art in light of the foregoing 
description. Accordingly, it is intended that the present invention embrace all such 
alternatives, modifications and variations as fall within the scope of the appended 
claims. 

What is claimed is: 
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